Papers with entity unlearning
Which Retain Set Matters for LLM Unlearning? A Case Study on Entity Unlearning (2025.findings-acl)
Copied to clipboard
| Challenge: | Large language models (LLMs) are prone to retaining unauthorized or sensitive information from their training data, which raises privacy concerns. |
| Approach: | They propose to use a group of queries that share similar syntactic structures with the data targeted for removal to investigate the effects of unlearning on various subsets of the retain set. |
| Outcome: | The proposed method reduces the retention set, the portion of training data that is not targeted for removal, and improves model performance across subsets. |